LINEAR STOCHASTIC SYSTEMS: A WHITE NOISE 
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DANIEL ALPAY AND DAVID LEVANONY 

Abstract. Using the white noise setting, in particular the Wick 
product, the Hermite transform, and the Kondratiev space, we 
present a new approach to study linear stochastic systems, where 
randomness is also included in the transfer function. We prove 
BIBO type stability theorems for these systems, both in the dis- 
crete and continuous time cases. We also consider the case of dissi- 
pative systems for both discrete and continuous time systems. We 
further study £1-^2 stability in the discrete time case, and L2-L00 
stability in the continuous time case. 
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1. Introduction 

In this paper we propose a new approach for the study of uncertainty 
within the theory of linear stochastic systems, and prove a number of 
stability theorems. To set the problems and results in perspective we 
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begin with a brief historical introduction. Linear system theory, oper- 
ator theory and the theory of analytic functions have a long history of 
interactions, and two notable milestones are the work of M. Livsic on 
the characteristic operator function, see [15], [35], [32], and the work 
of R. Kalman, see [39] . The discussion of what is linear system theory 
would lead us too far away, and we refer the reader to [38] for more 
information. We also refer to [33] and [1] for surveys and to [23] for a 
discussion of stability results in the continuous time case. 



For the purpose of this introduction, a discrete-time, time-invariant 
linear system will be described by an input-output relation of the form 

(1.1) y n = (h*u) n = ^2h n „ m u m , neZ. 

In this expression, the h n are pre-assigned complex numbers, which 
stand for the impulse response of the underlying system, and the input 
and output are required to define a continuous map between specified 
spaces Hi and TC Q (and of course, this entails conditions on the coeffi- 
cients h n ). These various conditions are translated into properties for 
the ^-transform 

(1.2) h(Q = Y,CK 

of the sequence (h n ). For instance, when the system (11.11) is causal, 
that is, when h n = for n < 0, it defines a contraction from l?J(Zl) into 
itself (the system is then called dissipative) if and only if the function 
h is analytic and contractive in the open unit disk (such functions are 
called Schur functions), or equivalently, if and only if the operator of 
multiplication by h is a contraction from the Hardy space of the open 
unit disk H^©) into itself. This allows to resort to all the tools of 
Schur analysis to study such systems; see for instance [20], [29], [30J. 

Note that h is called in system theory the transfer function of the sys- 
tem. In certain fields (e.g. engineering) it is defined with (~ 1 instead 
ofC 

The system ( 11.11) commutes with the shift operators S 

(1.3) S(xj) = (x j+x ) 

defined in the input and output spaces. In system theory terminology, 
it is called time-invariant. In fact, every time-invariant linear bounded 
system from ^(^) into ^(^O is of this form. The proof of this well 
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known result is recalled in the sequel; see STEP 1 in the proof of The- 
orem 15 . 11 Such a characterization does not hold when one considers 
£oo(Z) instead of tiffi), a s we will explain below. 

The notion of Schur function and the associated system theory inter- 
pretations, have been extended in a number of directions, well beyond 
the time-invariant case. We now discuss some of them. First, when 
considering the time-varying case (that is, when /i„_ m in ( 11.11) is re- 
placed by /i„ )m ), an approach originating with the work of Deprettere 
and Dewilde, see [TT] , [TjJ], consists of replacing the complex numbers 
by diagonal operators. In the later works [5J, [1], the Hardy space is 
replaced by the Hilbert space of upper-triangular operators of Hilbert- 
Schmidt class, and and Schur functions by upper triangular contrac- 
tions. This allows, with an appropriate definition of point evaluation 
of an operator on a diagonal, to extend much of the function theory of 
the open unit disk, to the case of upper triangular operators, and hence 
to apply the results to time- varying systems. See [2JJ, [9], [2], [5] for a 
sample of papers, and [22J for applications of this calculus on diagonals. 

Among other directions of research and extensions we mention the case 
of multi-indexed systems and their connections to several complex vari- 
ables, see for instance |10| . and the non- commutative case, see for in- 
stance [TT] . 

In all the directions outlined above, there is no randomness in the sys- 
tem itself, although the input (and hence the output) may be a sequence 
of random variables. In the present work it is a different kind of exten- 
sion which we consider, allowing the h n in (11.11) to be random variables. 
We use white noise space analysis, which has been introduced in 1975 
by T. Hida, see [51] . and the monographs [35], [36] and [UJ. White 
noise analysis allows to translate problems from the stochastic context 
into problems involving analytic functions in a countable number of 
variables in the Fock space, or in spaces of distributions which contain 
the Fock space, in particular in the Kondratiev space. The Wick prod- 
uct is a generalization for random variables in the Kondratiev space 
of the pointwise product, and reduces to the pointwise product when 
at least one of the factors is nonrandom. It became very useful when 
stochastic calculus with respect to the fractional Brownian motion, 
and more generally with respect to processes which are not necessarily 
semi-martingales, began to be considered; see [36], [25], [26], [27] . 
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Obviously, a Gaussian input into a linear system with nonrandom coef- 
ficients, will result in a Gaussian output. Here, we aim to model linear 
Gaussian input-output relations when the underlying linear system is 
random. While indeed a Gaussian input into a linear system with ran- 
dom coefficients cannot be expected to result in a Gaussian output, we 
will use the white noise space setting and replace the pointwise product 
by the Wick product, enabling Gaussian input-output relations when 
the underlying system has random coefficients. This has the advantage 
of preserving the Gaussian input-output relation, while allowing un- 
certainty in the form of randomness in the linear system under study. 
Thus, we replace ( II. ip by 

(1.4) y n = ^ h n - m 0u m , neZ, 

where the y n , u n and h n are now random variables in the Kondratiev 
space (or more precisely, in some Hilbert subspace of it), and where 
denote the Wick product. We also consider the causal case, where now 

n 

(1.5) y n = ^ h n - m <)u m , n = 0,1,2,... 

m=0 

The proposed setting can be used to model uncertainty of an other- 
wise deterministic linear time-invariant system, a system that main- 
tains Gaussian input-output relation, by a random uncertainty in the 
impulse response. This is known as the Bayesian embedding approach, 
by which the study of a nonrandom uncertainty is carried out through 
an associated probabilistic analysis; see e.g. [30] , [4"4] . We now turn 
to the content of the paper, and first recall three stability theorems, 
namely, Theorems 11.11 11.31 and 11.41 The main aim of the paper is to 
develop counterpart of these (and of some other) theorems in the sto- 
chastic setting, as is explained below. 

Consider a linear discrete time system of the form (11.11) . Various no- 
tions of stability can be assigned to such a system; in this work we will 
focus in particular on B1BO stability (bounded input bounded output), 
£i-£2 stability and the case of dissipative systems. With B1BO stability 
in mind, the following result is well known; see for instance [38| p. 177]. 

Theorem 1.1. There is a M > such that the sums ^2 me ^h n ^ m u m 
converge absolutely for all (u m ) G £oo(Z) ; all neZ, and 



(1.6) 
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if and only if 

(1.7) $^|/g<M. 

Condition (11.71) means that the ^-transform (11.21) of the impulse re- 
sponse is in the Wiener algebra W] h is in particular continuous on 
the unit circle, but it need not be defined in general for |£| ^ 1. In the 
case of a causal system, and when h is rational, (11.71) can be given a 
nicer interpretation. Recall first that a rational function which has no 
pole on the unit circle is in the Wiener algebra; its Taylor coefficients 
at the origin (if the function is assumed analytic in a neighborhood 
of the origin) will not, in general, be equal to the Fourier coefficients 
of its expansion as an element in W . They will be the same when all 
the h n = for n negative, that is, when the system is causal. Still for 
causal systems, condition (11.71) means that the function h is analytic 
in the open unit disk D, and continuous on the closed unit disk. Thus, 
when h is assumed rational, it belongs to the subalgebra W + of W. We 
also note that in this case, h has no pole in the closed unit disk. We 
refer to [31] for these facts and for more information on the Wiener 
algebra. 

The system (II .ip defines a linear bounded operator from ^(Z) into 
£oo(Z) which commutes with the bilateral S defined by (11.31) ; this last 
property expresses the time-invariance of the system. We consider 
linear time-invariant systems whose input-output relation is given in 
the form of a convolution. We note however that not all linear time- 
invariant systems from £oo(Z) into itself are given by a convolution. For 
instance, define X e (^(Z))* by 

X Q (x) = limsup — 3 ~ " — . 

2n + 1 

The operator 

(1.8) X(x) = (X S**{x)) j& , 

defines a bounded linear operator from ^(Z) into itself, which com- 
mute with S, but cannot be expressed by a convolution. 

We denote 

N = {1,2,...} and N = NU {0} . 

To discuss £i-^2 stable and dissipative systems, it is easier to consider 
signals indexed by N . We recall that the Hardy space H 2 (D) is the 
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space of power series 

oo 
n=0 

with norm 



11/lkcD) = (2J/» 



oo 

, , ,2x1/2 



n=Q 



The following definition and result are well known: 

Definition 1.2. The system ( II. ip will be called bounded if 'there 
exists a M < oo such that 



1/2 



v n=0 / n=0 



For the matrix-valued version of the theorem below, see [7J Theorem 
5.1]. 

Theorem 1.3. The system (jl.4p £1-^2 bounded if and only if its 
transfer function is in the Hardy space H^B). 

The £2 (No) norms of the input and output sequences are a measure of 
the energy of the signals, and play an important role in system theory; 
see pQ for a survey. The system (II .ip is called dissipative if the £2(^0) 
norm of the output is always less or equal to the £2(No)-norm of the 
input. The following result characterizes systems of the form (11.11) 
which are dissipative. 

Theorem 1.4. A linear system is time-invariant, causal and dissipa- 
tive if and only if it is of the form (11.11) with a transfer function which 
is analytic and contractive in the open unit disk. 

In other words, the system has a transfer function which is a Schur 
function. Equivalently, the lower triangular Toeplitz operator 

/h • -\ 

(1.9) I 1 h h ° h " 

n 2 hi h ■ ■ 

v / 

is a contraction from £2(^0) into itself. 



We note that, through the Z-transform, the space £2(^0) is unitarily 
mapped onto H 2 (D), that is, onto the reproducing kernel Hilbert space 
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with reproducing kernel 

(1.10) tf(^) = _L_ (,,gd. 

Therefore, h is the transfer function of a dissipative system if and only 
if the operator of multiplication by h is a contraction from H2(D) into 
itself, or, equivalently, if and only if the kernel 

an) i-KOk^T 
1 ' ' i-Cv* 

is positive in the open unit disk. The associated reproducing ker- 
nel Hilbert spaces were introduced and studied by de Branges and 
Rovnyak, also in the operator- valued case; see [13] , |15j . We will use 
some of their results in the sequel; see Theorem | 



We wish to extend the notion of transfer function so as to include a ran- 
dom aspect, and present counterparts of the three theorems mentioned 
above in a random systems setting. We will also consider the contin- 
uous case for BIBO stability, dissipative systems, and L^-Lqo bounded 
systems. Using the white noise setting and the Hermite transform this 
random aspect will be expressed by dependence on a countable num- 
ber of independent complex variables z\ , z 2 , . . . . This is reviewed in 
the next section. First we need to recall some of the relevant nota- 
tions at this stage. In the following expressions, I denotes the set of 
finite sequences of integers indexed by N, that is, the set of sequences 
(nx,n 2 , . . .) where rij = for all large enough j, and we set (see [201 
(2.3.8) p. 29]) 

The product is meaningful since aij = for all but for a finite number 
of indices j. 

In our approach, we replace the kernel (ll.lOp by a kernel of the form 

K k (z,w) 
1-0/* 

where z = (z lt z 2 , . . .) and w = (wi, w 2 , ■ ■ .) belong to the infinite di- 
mensional neighborhood 

= (z u z 2 , . . .) G C N : M 2a (2N) fca < oo 
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of the origin in C N (see [36, Definition 2.6.4 p. 59]), and where 
(1.12) K k (z, w) = z a {w*) a {2N) ka , 

with the use of the multi-index notation: 

z a = z® 1 ■ z% 2 • • ■ , where a = (oti, a 2 , ...). 

We denote by Ti{Kf.) the reproducing kernel Hilbert space with re- 
producing kernel Kk(z, w). Elements of H(Kk) are analytic in z = 
(z±, Z2, • • •) in the set To take into account randomness, we replace 
the Hardy space H 2 by H 2 <8> H(Kk). Note that 

{oo 
/(C) = ^2Cfn with f n eH(K k 

with norm 



n=0 



n=0 



A transfer function will thus be a function Jff(C, z) of the form 

oo 

(1.14) J^(C,z) = J2CK(z), 



n=0 



where now the h n e Ti,(K k ). In (j!.14p . the nonrandom part of the 
transfer function is 

oo 

(1.15) ^(c,o) = ^c n Mo). 

n=0 

As we explain in the sequel, another possible generalization is to write 

(1.16) jr(c,z) = MC) + ;>> Q c Q (C). 

a<=£ 

The nonrandom part in (j!.16p is 

(1.17) ^(C,0)=%), 
corresponding to a = 0. 

The transfer function z) of a dissipative random system will be 

characterized by the positivity of the kernel 

(1.18) (1 - Jg>(£, z)J?(is, to)*) K ,A '' ' "' ' 



;i-c^) 
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in © x Kfc, that is, J4?(C, z) is a contractive multiplicator of the repro- 
ducing kernel Hilbert space H 2 (]TI ) ) <8> H(K k ) with reproducing kernel 



A similar interpretation will hold in the continuous case, where the 
open unit disk is now replaced by the open upper half-plane. 

The outline of the paper is as follows. The paper consists of eight 
sections besides the introduction. In the second section, we review the 
white space noise setting, and define analogs of the linear systems (II. ip 
and of their continuous time versions when we allow randomness both 
in the impulse response (h m ) and in the inputs (u m ). In Section 3 we 
prove the counterparts of Theorems 11.11 The cases of Theorems 11.31 
and 11.41 are considered in Section 4 and 5 respectively. The next three 
sections are devoted to the continuous time case. In Section 6 we prove 
the operator-valued version of the Bochner-Chandrashekaran theorem. 
In Section 7 we consider the analog of BIBO continuous systems and in 
Section 8 the case of continuous dissipative systems. In the last section 
we consider the case of L 2 -Loo stability. 

The theory of random linear systems is yet not well established, and 
it appears that the setting presented in this paper is the first which 
permits to handle, in an efficient way, the case where randomness is 
allowed in the impulse response. 

We denote by 



the Fourier transform, where / G L 2 (R), or, more generally, belongs 
to L 2 (K) <8> Tt for some Hilbert space TL. For a Hilbert space TC, the 
symbol L(7Y) denotes the set of bounded operators from Ti into itself. 



We now briefly recall the definitions of the white noise space and of 
the Kondratiev space. We refer to [35], [36], [JT], P2] and [28] for more 
information. 

The function 




2. The white noise space setting 



K(si - s 2 ) = exp(-||si - s 2 ||l 2 
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is positive on the Schwartz space S of rapidly decreasing, infinitely dif- 
ferentiable functions. Since S is a nuclear space, the Bochner-Minlos 
theorem (see [32J, Theorme 2 p. 342]) ensures the existence of a prob- 
ability measure P on the Borel sets T of = <S' such that 

f e ^^dP(u;) = exp(-\\s\\l 2m /2). 
Jn 

The white noise space is W = L 2 (f2, J 7 , P). An orthogonal basis of the 
white noise space is given by the Hermite functions (H a ) ae £. These 
functions are computed in terms of the Hermite polynomials, and we 
refer to [36], Definition 2.2.1 p. 19] for their definition. Every element 
in W can be written as 
(2.1) 

F(u) = c a H a {u)i c a G C, with H-FHvv = l c °| 2a ' < 00 

In general, one takes real c a . Here we take complex coefficients, that is, 
we consider the complexified real white noise space. A similar remark 
holds for the spaces H(K k ) defined below. 

Let z = (zi,Z2,...) G C N . The linear map which to H a associates 
the polynomial I(H a ) = z a extends to a unitary map between the 
white noise space and the real reproducing kernel Hilbert space with 
reproducing kernel exp (z,w)e 2 . This space is called the Fock space. 
The map I is called the Hermite transform. The Wick product is 
defined through the Hermite functions by 

H a 0H p = H a+ p, a,/3e£. 

It is in fact independent of the chosen basis in the white noise space; 
see [36J Appendix D, pp. 209-215]. In general, the Wick product of two 
elements in the white noise space need not be in the white noise space. 
The most convenient space which is stable with respect to the Wick 
product is the Kondratiev space To define S-i we first introduce 
for A; G N = {1, 2, . . .} the Hilbert space H. k which consist of series of 
the form (12.1 p such that 

(2-2) 11/11/=" ($> a | 2 (2N)- fc ^ <oo. 

Note that the the Hermite transform is a unitary mapping from Tik onto 
the reproducing kernel Hilbert space with reproducing kernel Kk(z, w), 
where Kk is defined in (11.121) . The Kondratiev space S-\ is the induc- 
tive limit of the spaces Tik- We note that when either one of the factors 
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/ or g in S-i is nonrandom, the Wick product f()g reduces to the point- 
wise product fg. 

We will consider stochastic processes in the series form 
(2.3) X{T > u) = ^2c a (r)H a (u), 

where the c a (r) are nonrandom functions depending on a parameter r. 
We require that the series (12.31) belongs to the Kondratiev space S^i for 
every value of r. Here r belongs to the integers or to the real numbers. 
We note that other choices of indices are possible (for example, Z 2 , or 
the case of the vertices of a binary tree). We also note that a case of 
special interest arises when one applies the Hermite transform and the 
Laplace transform (for the continuous time case) or the ^-transform 
(for the discrete time case), to obtain a function which depends on a 
finite number of variables Zi, which, in addition, is a rational function 
in these variables, that is, is a function of the form 



M M 

(2.4) D(C) + C(C)(In - ^(0) _1 E z k B h (C)). 

k=l k=l 

Here, ( denotes the variable corresponding either to the Laplace trans- 
form, or the ^-transform. The functions of ( in that expression are 
also assumed rational. See [Sj. Other type of realizations are possible; 
see Theorem 15.21 below. 

3. BIBO STABLE LINEAR DISCRETE TIME STOCHASTIC SYSTEMS 

Fix some integer I > 0, and let k > I + 1. Consider h <EHi and u e Hk- 
Then, Vage's inequality (see [361 Proposition 3.3.2 p. 118]) is in the 
form 

(3.1) \\hOu\\ k < A(A;-0I|/i||jNI*, 
where 

(3.2) A(k-l) = J2( m ) il ~ k)a - 

aee 

It is not a trivial fact that A(k — l) is finite; see [52] and [251 Proposition 
2.3.3 p. 31] for a proof. 



Inequality (13. ip expresses the fact that the multiplication operator 

T h : u i— > h()u 
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is a bounded map from the Hilbert space Hk into itself, and that its 
operator norm ||I\|| p,j,i; satisfies the inequality 

(3.3) \\T h \\ op , l>k < A(k - l)\\h\\i. 

The norm of Th depends on k and I and will be in general different 
from \\h\\i. It implies in particular that Hi endowed with the norm 



I 7 II def. ||m || 

— \\ 1 h\\op,l,k 



is a normed algebra. 



To simplify the notation, we set 

||7)i||op,/,fc = \\Th\\- 

Definition 3.1. A random discrete time signal will be a sequence (u n ) 
indexed by 7L, of elements in the Kondratiev space, such that there exists 
a k G N (depending on the signal) such that 

u n G Hk, Vn G Z. 

We note that k is imposed to be independent of n. 

Theorem 3.2. Let k > I + 1 and let (h n ) be a sequence of elements in 
Hi indexed by Z. Then 

(a) The sums (11.41) 

Un = ^ K-m<)u m , neZ, 

converge absolutely in Hk for all inputs (w m )mez such that sup meZ ||w m ||fc < 
oo ; and 

(b) There exists an M > such that, for all such inputs (u n ) n< =z, it 
holds that 

(3.4) sup \\y n \\k < Msup ||« n || fe 

neZ nGZ 

if and only if for all v G Hk with \\v\\k = 1 it holds that 
(3-5) "£\\TZ n (v)\\ k <M. 



We note that, in the nonrandom case, where the h n are (nonrandom) 
complex numbers, the Wick product reduces to a pointwise product, 
and we have systems of the form (11.11) . Furthermore, in this case, 



LINEAR STOCHASTIC SYSTEMS: A WHITE NOISE APPROACH 



13 



and we retrieve the well known BIBO stability condition ( 11. 7ft . with 
Theorem 13.21 reduced to Theorem 11.11 

Furthermore, we notice that condition 

^||7U<M 

on the norms of the operators T^ n implies condition (13.51) . Expressions 
of the form 

E ™» 

with 

E ii T ^n < 00 

form an algebra, which appears to be the counterpart of the classical 
Wiener algebra in the present setting. 

Proof of Theorem 13. 21 First note that, in view of the restriction 
k > I + 1, each of the terms in (11.41) belongs to Hk- 

Assume that ( 13.41) is in force. Then, for every n6Z, taking sequences 
(u m ) which have only a finite number of non zero entries, one has for 
any preassigned n G Z, 



MSUP \\U m \\ k > || E T hn-m(> 



meZ 



SUP (E T ^- m <>Mm,w)fc 



HU =1 



sup (E M m ,T* n _ m (i;)) A 

m£Z 



II II _i m 6 



The special choice 



, if ||t* («)|U^o 

0, if («)|U = 



leads to 



E ii r /L>)iu<^- 



me* 
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This expression stays the same also for the indices m such that u m ^ 
since u m ^ if and only if _ (i;) \\ k ^ 0. Finally, since the right 
handside of the above inequality is independent of the support of (u m ) 
we get the result. 

Conversely, assume that ( 13.51) is in force. Then, still for sequences (u m ) 
with only a finite number of non zero entries, we have 

II Yl T hn- m Um\\k = SUp U m ,T^ n _ m (v)) k 
u m ^0 \Mk-l Um ^ 



< SUp Y \\ U m\\k\\Th n _ m V\\ k 



< sup \\u m \\k -sup W T h. 

a m7^v \\V 



(v)\\k 



< M sup \\u m \\ k . 



Assume now that the sum 



in —. 



converges absolutely in Ti k . The result is then obtained by continuity 
by considering partial finite sums. □ 

Applying the Hermite transform to equations (11.4j) . that is to 

Vn = ^ h n _ m ()u m , n 6 Z, 

leads to the following: let 

y n {u) = ^2y a (n)H a (u) and h n (u) = ^ h a {n)H a (u), 

where the coefficients y a (n) and h a (n) are nonrandom complex num- 
bers. Then, 



a£i \meZf3<a 



p{n — m)up{m) I , n e Z, 
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that is, after taking the Hermite transform 



ik^Xy (EE^ 

a&l \mEZf3<a 



'n — m)up(m) ) , n G Z, 



and hence, 



(3.6) y a (n) = ^ ^/^(n - m)up(m), n e Z. 

meZ /3<a 

Equation (13.61) exhibits two convolutions: the first is with respect to 
the index in £, which is related to the stochastic aspect of the system; 
the second is with respect to the time variable. 

The Z transform (denoted by y, with variable () then leads to 



y((,z) d = £lfon)C n 



def. 



aei /3<a 



Definition 3.3. T7ie function 

is i/ie called generalized transfer function of the system. 

When all /i Q (C) = for a 7^ 0, we retrieve the classical notion of the 
transfer function. We can thus define a hierarchy of systems, depend- 
ing on the properties of the function Jf((,z). The rational case will 
be when the function J4?(£,z) is of the form (12.41) . Another case of 
interest would be the isospectral case, when the function A(() in (12 .4p 
does not depend on the variable £. 



4. STABLE RANDOM SYSTEMS 

The analog of Theorem 11.31 is the following: 
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Theorem 4.1. Let I > k + 1 and assume that in the system (11.51) 
h n ^7ii. Then there exists M > such that 

(oo \ V 2 oo 

n=0 / n=0 

/or all inputs (u n ) such that the right handside of the above equation 
is finite, if and only if its transfer function belongs to 112(115) ® TC(Ki), 
i.e. if and only if there exists a number c > such that the kernel 

(4.1) ^l^l^ c je(C,z)Jf(u,wy 
1 - Qv* 

is positive in D x . 

The system (jl.4p is then called bounded. In the proof of the theo- 
rem, we use the already mentioned fact that the spaces Tik and H(K k ) 
are unitarily equivalent via the Hermite transform. This allows us to 
make use of Vage's inequality in the spaces H(K k ). 

Proof of Theorem (14.11) : We first remark that the equivalence of 
(jO) with the condition Jif G H 2 (D) <8> H{K k ) directly follows the 
characterization of the elements of a reproducing kernel space. We 
proceed in three steps. Recall that A{k — I) has been defined by (13. 2p . 

STEP 1: Assume that flU]) holds, and let u G H{K k ). Then, 

(4.2) || x\\n 2 (p)®H(K k ) < A{k - £)\\<3%'\\ii i (p)®H{K l ) • \\u\\n{K k )- 



Indeed, let Jt?((,z) = J2n=o ( nh n(z), with h n G H(K e ). Then, 

oo 

\\^ u \\ll2(0)®K(K k ) = ll^n M llfe 

?1=0 

OO 

< A(k — I) 2 2j ll^n|lw(A' ; )ll M llw(^ fe ) 
n=0 

= A(k - Z) 2 ||^||h 2 (d)®7-^) • \\u\\ 2 H ( Kk) . 
STEP 2: Assume that (14.11) holds. Then, the system is bounded. 

We first note that, from the definition of the norm in H^B) ® T~t(K\), 
the operator of multiplication by ( is an isometry from H^IQ) <S> 7i{Ki) 
into itself: 

(4.3) \\M c F\\ H2imHiKl) = \\F\\ H2{mHm , VF G H 2 (D) <g> H(K X ). 
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Let u((,z) = Y^Lo ( nu n( z ), where the u n G TC(Kk). Then, 

oo 
n=0 

where the convergence is in H^©) <S)T~C(Ki), as will be justified by 
equation (14.41) below. So, using (14.21) and (14.31) . we have, with y((, z) = 

Er=o C n y n (z), 

2J I - \\y\\n 2 (0)<g)H(K k ) 

v n=0 / 



n=0 

00 

(4-4) < ^ ||^ g ^nl|H 2 (D)<8)M(A'0 



n=0 



< y4(A; - /) ||^||H 2 (D)<X)H(K ; )ll M n||w(K fc ) 



n=0 

00 



= M I \\ U n\\n{K k ) j ■ 
\n=0 

With M = A(k - l)\\J^\\Ka(p)m(Ki)- 

STEP 3: We complete the proof. 

Assume the system £1-^2 bounded. Since 1 G H(K k ) we have that 
J4?(C, z) £ H 2 (D) £g> TC(Kk), and we can use the previous step to con- 
clude the proof. □ 

When the system is not random, that is, when Jt? is only a function 
of C, the positivity of the kernel (14.11) is equivalent to the fact that 
Jf G H 2 (D). Indeed, the tensor product space H 2 (D) <8> H(K k ) can 
be seen not only as the representation (11.131) . but also as the space of 
functions of the form 

F(C,z) = XV/«, / a eH 2 (D), 

with the norm 

ll/a|lH 2 (D) 



\F\\^(W)®n{K k ) - 



(2N) fcc 
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5. DlSSIPATIVE DISCRETE TIME RANDOM SYSTEMS 

We denote by the operator of multiplication by Q and by M Zj the 
operator of multiplication by Zj (in both cases, the domain and range of 
these operators is given below). In the next theorem, the first condition 
expresses the time-invariance of the system. The second condition is 
needed to ensure that we get a multiplication operator. It can be 
interpreted as the property of invariance with respect to randomness. 
In the following statement, recall that the kernel K k has been defined 
by (HH. 

Theorem 5.1. Let fceN. The operators M z . are bounded from 7i(Kk) 
into itself. A linear operator from H^©) <8> T~t{K k ) into itself is con- 
tractive and such that 

T(M c f) = M c Tf 
{ ' } T(M Zj f) = M z Tf 

if and only if it is of the form 

(Tf)((,z) = z)f((,z) 

where 5? is such that the kernel ( 11.181) : 

K k (z,w) 



:i-y(C,z)y(v,w) 



(1-Cf) 

is positive in D x 

Proof: We divide the proofs into several steps. 

STEP 1: Let H be a Hilbert space, and let T be a bounded operator 
from £[2(0) ® Ti into itself which commutes with multiplication by (. 
Then, T is of the form 

77(C) = s(Of((), 

where S is an ~L(7i) -valued function analytic and contractive in the 
open unit disk. 

This is a well known fact (see for instance [131 Lemma 1 p. 301]), being 
the discrete analog of the Bochner-Chandrasekharan theorem (see [T3"| 
Theorem 72, p. 144] and Section [6] below for the latter). We briefly 
review its proof for completeness. Let c E TC. We have 



(Tc)(C) = J2C T n(c), 



n=0 
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where the operators T n are readily seen to be linear bounded operators 
from TC into itself. Furthermore, 



|T n || < ||T||, VnGNc 



since 



\\ Tc \\li2(n)®H = ^2 W TmC Wn > ll T nc||^, MceTC and \/n E N . 

m=0 

The L(7i)-valued function 

oo 

(5.2) S(C) = J2CT n 

n=0 

is analytic in the open unit disk (we refer to [191 pp. 189-190] for a re- 
view of operator- valued analytic functions, and the equivalence between 
strong and weak analyticity). We now show that it takes contractive 
values and that T = Ms- Since H 2 (D) <8> TC is the reproducing kernel 
Hilbert space with reproducing kernel 

In 

1 - Qv* 1 

convergence in norm implies weak pointwise convergence in the coeffi- 
cient space TC. Thus, for every c G TC, and every / e H 2 (0) Cg> TC in the 
form 

oo 

/(C) = X)C*7n, 
n=0 

using continuity of T, we have 

oo 

((Tf)(0,c) n = ((T(Y^M-f n ))(C),c) H 

n=0 

oo 

n=0 
oo 

= E^Wn)(o,c> w 



n=0 

oo 



J](C n 5(C)/„,c) w 



n=0 



= (5(C)/(C)c>«. 
Thus T = Furthermore, the formula 

^-)(C) = 

V 5 1-.Z7* AS; l-O* 



20 D. ALPAY AND D. LEVANONY 

implies that the kernel 
(5.3) InSiOSW 



is positive in D and in particular S takes contractive values. 
STEP 2: The operators M Zj are hounded in H(K k ). 
Indeed, let g(z) = Y. a ai c aZ a with 

\\9\\ 2 n(K k) = J2\ c ^^~ ka<oc - 

Then, with ej G £ denoting the sequence with all elements equal to 0, 
at the exception of the j-th, equal to 1, we have 

and 

\c a \\2N)- k{a+e ^ = \c a \ 2 {2N)- ka ((2N) ka {2N)- k{a+e ^) 
< 5> a | 2 (2N)- to 
and so M z . is a contractive operator in TC(K k ). 

STEP 3: We now take 7i = Ti.(K k ). The fact that T commutes with 
the operators of multiplication by Zj implies that 

(T n f)(z) = s n (z)f(z), 

for some L(TC(K k )) -valued function s n (z). 

Indeed, we have in particular 

T n (z a ) = z a T n (l). 
Thus, for f(z) = J2 a ee c <* za G W( K k) we have 

(T n f)(z) = J2c a T n (l) =T n (l)f(z), 

first for finite sums, and then using continuity of the operator T n for all 
/ G H(K k ) in the norm topology, and finally pointwise, since TL(K k ) 
is a reproducing kernel Hilbert space. 
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We set (T n (l))(z) = s n (z). The result follows with 

oo 
n=0 

Therefore T is a multiplication operator in the reproducing kernel 
Hilbert space H 2 (D) <g> H(K k ). Since it is a contraction, (ll.ISp is in 
force. 

The converse is clear: if a function is such that the kernel (I1.18P 
is positive on D x Ij., then the operator of multiplication by y is a 
contraction from H 2 (D) ® 7i{K k ) into itself, and satisfies the commu- 
tativity hypothesis (15. ip . □ 

When the system is not random, y((,z) depends only on ( and is a 
Schur function. 

We further remark that the function S(() defined in ( 15.21) is a h{T-C(K k ))- 
valued function, and the theory of realization for such functions is thus 
applicable to it; see [6]. Using the results of [6j we have: 

Theorem 5.2. Let y((, z) be a Schur multiplier of the space Ha(D) ® 
7i{Kk), and let 7i(y) the associated reproducing kernel Hilbert space. 
Then 



where 



with 



y((,z) = D + (C(I m y ) -(A)- L B, 

a b\ (n{y)\ ^ (n{y)\ 
cd)' [n(K k )J ~^ [n(K k )J 



(A f ){£,*) 



f((,z)-f(0,z) 

C 



(Bx){(,z) = x{z), 

(Cf)((,z)=f(0,z), 
(Dx)((,z)=y(0,z)x(z), 
defining a coisometric realization of y. 

Proof: Indeed, let Ti denote a Hilbert space, and let S be an L(7Y)- 
valued function analytic and contgractive in D. Then the kernel (15.31) is 
positive in the open unit disk. Let H(S) be the associated reproducing 
kernel Hilbert space. The formulas 
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{Am) = m^m i 

C/ = /(0), 
define a coisometric realization with 

c dj ■ \ n J \ n ) 

in the form: 

5(C) = j d + CC(/ W (5)-C^)" 1 5. 

Now, there is here an extra structure, which does not appear in the 
general case: there is a function y((, z) such that 

(S(\)x)(z) = z)x(z), x e H(K k ). 

The formulas for the realization of 5? then easily follow. □ 

Since constants belong to H 2 (D) ®7i{K k ), it follows in particular that 
z) G H 2 (D) ® H(K k ), and thus can be written as 



n=0 



The fact that the operator is a contraction is then equivalent to the 
fact that the block Toeplitz operator 





T h0 





(5.4) 


\T hl 


Tho 




\T h2 





is a contraction from the Hilbert space £2(^0) <8> Ti(K k ) into itself. 
As a consequence, we have: 

Theorem 5.3. Let k > I + 1 and let {h n ) be a sequence of elements in 
Hi indexed by N . Let 



Vn = ^ h n - m ()u m , n = 0, 1, 



m=0 
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Then there exists an M e [0, 1] such that, for all signals 



oo 



DC 



(5.5) 



u. 



1 1 2 
nllfc 



n=0 n=0 



i/ an<i on/t/ if (15.41) zs a contraction. 

6. The Bochner-Chandrasekharan theorem 

Let H be a Hilbert space. We denote for h e Rby T h the translation 
operator: 



where / is in L2QR) ® 7i. The fact that a bounded operator from 
L2(M) £g> H into itself commutes with all the Th, expresses the time- 
invariance of the underlying linear system. When 7i = C, the Bochner- 
Chandrasekharan theorem provides a characterization of all bounded 
operators from L 2 (M) into itself which commute with the T^, see [T3l 
Theorem 72, p. 144]. In the present section we show how the strategy 
of [TBJ allows to prove a version of this theorem in the case of Hilbert 
space valued functions. Our approach consists of reducing the operator- 
valued case to the scalar case, but we need an extra assumption (the 
invariance property ( 16. ip ). which means that we consider causal sys- 
tems, a property which holds in the cases considered in the paper. We 
first prove the following result. Its scalar version is [T3"l Theorem 70, 
p. 140]. In the statement of Theorem l6.lt for a given Hilbert space Ti, 
the Banach space of bounded operator from TC into itself is denoted by 
h(TC). Moreover, we denote by H2(C + ) the Hardy space of the open 
upper half plane C+. 

In connection with this theorem, it is of interest to mention the fol- 
lowing result proved in [571 Theorem 1 p. 397]: First recall that £' 
denotes the space of distributions with compact support, and that V 
denotes the dual of the space T> of infinitely differentiable functions 
with compact support. Then, any linear continuous map from £' into 
V which commutes with the translation operators is a convolution by 
a tempered distribution. See also the discussion in [121 p. 35]. 

Theorem 6.1. Let 7i be a separable Hilbert space, and let X be a 
bounded linear operator from L 2 (R) <S> 'H into itself. Assume that if 
f vanishes outside an interval, then Xf vanishes outside the same 
interval. Assume moreover that 



(T h f)(t) = f(t + h) 



(6.1) 



X(H 2 (C+) ® H) C H 2 (C+) ® n. 
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Then, there exists a L(7Y) -valued function S bounded in norm and an- 
alytic in C + such that X is the operator of multiplication by S: 

Xf(X) = S(X)f(X), /GH 2 (C + )®K, AeC + . 

Remark 6.2. Bochner and Chandrasekharan call an operator which 
has the vanishing property of Theorem \6.1\ a transformation of simple 
type. 

Proof of Theorem I6.lt Let eg, ei, ... be an ortho normal basis of 7i. 
For n,m £ No, the expressions 

(6.2) (X n , m (u))(t) = ({X{ue n )){t),e m ) n , u £ L 2 (R). 

define bounded linear operators from Ii2(M) into itself since, by the 
Cauchy-Schwarz inequality 

\(X n>m (u)){t)\ < \\{X{ue n )){t)\\ H , 

and so 



\(X n>m (u))(t)\ 2 dt < / \\X(ue n )\\ 2 n (t)dt 



l^( Me ri)llL 2 (R)®W 



< II^H I|we n ||£ 2 
= \\X\\ 2 -\\u\\l 2i 



Moreover, the X n>m are transformations of simple type since X is a 
transformation of simple type; therefore, by [T3], Theorem 70, p. 140], 
there exist bounded measurable functions s m , n such that 

(6.3) ((X(ue n ))(t), e m ) n = s m , n (t) ■ u(t) u £ L 2 (R). 

From the proof in [13| we moreover have that 

sup \s m ,n{t)\ < ||T||. 
teR 

Setting u = (f, e n )n with / £ L 2 (M) <S> 7i in (I6.3p . we obtain 

(6.4) ((X((f, e n ) H e n )){t), e m ) n = s n , m {t) ■ (f(t), e n ) H 
for every / £ L 2 (M) ® H. 

Summing ( 16. 4ft with respect to n we expect to obtain 

oo 

(6.5) ((Xf)(t), e m ) n = V»W ■ (/(*), en)n, ™ = 0, 1, 2, ... , 

n=0 

to show that 
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where S(t) is the operator with matrix (s m)n (t)). We cannot justify 
these computations in the general case (see also the remark following 
the proof of the theorem), and at this stage of the proof, hypothesis 
( 16. ip is applied. 



In view of ( 16. ip . the functions s m>n are analytic in the open upper half- 
plane. The space H2(C + ) is the reproducing kernel Hilbert space with 
reproducing kernel 

A, fi G C+. 



-i(A - ii*)' 

and therefore convergence in norm in this space implies pointwise con- 
vergence. Thus it follows from 

oo 

(6.6) Xf = Y,(Xf,e n ) H e n , 

o 

where the convergence is in H2(C + ) <S> TC, that for every m G No and 
A G C+, 

oo 

m=0 

oo 

= ^2 s ™,™( A )(/( A )' e ™)w 



m=0 



(S(X)f(X),e n ) 



H- 



□ 



Remark 6.3. Given a sequence of L 2 (R) functions which converges in 
L 2 (M), there exists a subsequence of this sequence which converges al- 
most everywhere; see for instance [HI Theoreme 2.3 p. 95]. Therefore, 
without assumption (16.11) . convergence in norm of the series (16.61) and 
a diagonal argument allows to assert that, for a given / G L 2 (M) <8> H., 
( 16. 5p holds almost everywhere on the real line when the limit is taken 
via a subsequence. 

Recall that we denote by U the Fourier transform. We can now prove: 

Theorem 6.4. Let X be a bounded operator from L 2 (M) ®H. into itself 
which commute with translation operators, and assume that UXU^ 1 
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satisfies ( 16. ip . Then there exists a L(7Y) -valued function S such that 

uxu- 1 ! = S(t)f(t), f e H 2 (C + ) ® w. 

Proof: Let X mn be defined by (16. 2p and /iet Since X commutes 
with the T/i, we have for u G L 2 (1R 

(2X(X mjn tt))(t) = ((X(we„))(t + h),e m ) H 

= ((X(T h u))(t)e m ) H 

= (X m , n (T h u))(t), 

and thus X m n also commutes with the translation operators. We now 
apply [T3], Theorem 72, p. 144-147] to show that the image under the 
Fourier transform of X m ^ n is of simple type, which allows to conclude 
the thanks to the preceding Theorem 16.11 □ 



7. BIBO STABILITY: THE CONTINUOUS TIME CASE 

In the classical case, one considers the Hardy space H 2 (C + ) of the open 
upper half-plane, and, in the stochastic case, we will consider the space 

In this section we restrict ourselves to the case of continuous functions 
t i — > f(t) from the real line to Tik for some k > 1. Then, there is no 
difficulty to define the integral J a f(t)dt on a compact interval, and, 
with appropriate hypothesis, also on the real line. Obviously, more 
general situations can be considered. These will not be pursued in the 
present paper. 

A continuous signal will be an 7i fc -valued continuous function 1 1— > u(t) 
defined for t 6 R, and such that 

SUp \\u(t) Hfc < oo. 

Lemma 7.1. Let k > I + 1. Assume that t i— > /(£) is a continuous 
Tii-valued function and t ^ g(t) is a continuous Tik-valued function. 
The TCk-valued function 1 1— > f(t)()g(t) is continuous with respect to the 
norm ofTik- 

Proof: to prove the claim, it suffices to write 

f(ti)0g(h) -f(t 2 )0g(h) = (f(h) - /(* 2 ))0<?(*i) +f{h)§{g{h) -g(t 2 )) 

for ti,t 2 6 M and use inequality (13. ip . □ 
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Definition 7.2. A continuous linear time-invariant stochastic system 
will be defined by its S^i-valued impulse response 

(7.1) h{r,u) = ^h a {r)H a {u). 

The associated input-output relation is in the Wick convolution form 

y(t) = / h(t - T)Qu(r)dT 



Theorem 7.3. Let k > I + 1. Let t \— > h(t) be a continuous Tii-valued 
function {t G R). Then: 
There exists M > such that 
(a) The integrals 



(7.2) y(t) = / h(s)0u(t - s)ds, Vt G R, 

exzsi /or a// continuous TCk-valued functions u such that 

sup \\u(t) \\k < oo 

M 

and 

(6) it holds that 

(7.3) sup || / h(s)§u(t — s)ds\\k < M sup \\u(t)\\k 

if and only if for every continuous g G Hk of norm less or equal to 1, 
it holds that 



(7-4) / IIT^U^ < M 

JR 

Proof: We first remark that the continuity of the function t i— > h(t) 
implies the continuity of the function t \—* ||T^ t ^o||fc. Indeed, we have 
for ti,t 2 G R 

WlTh^dWk ~ \\Th {t2) g\\k\ < \\(T; i{tl) -T* {t2) )g\\ k 

- \\9\\k ■ \\Th( tl ) - T h(t 2 )\\ 

= \\g\\k ■ \\Th( tl )-h(t 2 )\\ 

— WdWk ■ \\Th(ti)-h(t2)\\ 

<A(A;-0l|ff|| fe -||^i)-^2)lb 

where we have used (13. 3 p to obtain to the last inequality. Thus, the in- 
tegral on the left handside of (17.41) makes sense as a possibly divergent 
integral. We now show that it converges. 
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Assume that ( 17. 3ft is in force. Then, for every real t, 

\\h{r)0u{t - r)dr\\ k < Msup \\u(t)\\ k . 

t£R 

Hence, we have that 

\{h(r)()u(t - r)dr,g) k \du < Msup ||w(t)||fc, 

teR 

and thus 

| / (h{s)0u{t -s),g) k ds\<M sup \\u{t)\\ k , 
Jr r 

for every g G 7i k of norm less or equal to 1. Hence, for such g, 

(7.5) | / (u(t-s),T* {s) (g)) k ds\<M sup \\u(t)\\ k . 

Jr r 

Let e > and t fixed in R. The function 

u(s) = 77— — — n 

is continuous in s with respect to the norm of H k . Its substitution in 
(1731) leads to 



Taking e = n = 1,2,... and using the Monotone Convergence 
Theorem then leads to (17.41) . 

Conversely, assume that (I7.4p holds, and let u be a 7-^-valued contin- 
uous and bounded function. From 

\(h{s)0u(t- s),g) k \ = \(u(t- s),T£ {s) (g)) k \ 



we obtain that 



and thus 



< sup \\u(s)\\ k \\T^ s) (g)\\ k , 

s€R 



\(h(s)<)u(t - s),g) k \ds < Msup ||«(s)|| fc , 

s£R 



/ | (h(s)§u(t — s), g) k \ds < M sup \\u(s) 
Jr sgr 



Since this inequality holds for all g e TL k of norm less or equal to 1, 
we obtain (17. 3p . In the above chain of equalities we have used the 
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following (see [23j (8.7.6) p. 169]): given a Hilbert space Ti and a Ti- 
valued continuous function h such that J R h(s)ds exists, then, for any 
g ETC, it holds that 



(/ h(s)ds,g) n = / (h(s),g) H ds, 
Jr Jm. 

which concludes the proof of the theorem. □ 
We note that a weaker condition than (17.41) is given by 

(7.6) / \\T h{t) \\dt< M, 

Jr 

where, in view of the continuity of h, the integral makes sense since, 

by m, 

\\T h{tl) - h(t2) \\ < A(fc-Z)||fc(ti)-M*2)||/. 



We note that, when h is not random, the Wick product reduces to a 
pointwise product, and so (17.41) reduces to the well known condition 



\\h\\{t)dt < oo. 

See for instance [38, §2.6.1. p. 175] or |48l Corollary 3, p. 585]. 

Finally, write u(t) = Y2 a u a{t)H a , and similarly for the output. Tak- 
ing the Laplace transform (denoted by u), followed by the Hermite 
transform, we obtain an expression of the form 

where we have denoted by £ the variable corresponding to the Laplace 
transform. 

Proposition 7.4. It holds that 

(7-7) y(z,C) = J2 Z " |EMO^-/3(o} ■ 

Proof: For given real numbers r and t we have 



h{t - r)Ou(r) = V < V M* - t-K-^t) ^ # a (a; 
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and so, y a is given by 

(7.8) ya{r)= / ^y]hp(t - T)u a -p{T)dr 

Taking Hermite and Laplace transforms leads to (17.71) . □ 

We see that as in the discrete time case, in continuous time, we also 
have two convolutions, one with respect to time and one reflecting the 
stochastic aspect of the system. 

8. DlSSIPATIVE CONTINUOUS TIME RANDOM SYSTEMS 

For t > let Xt denote the function 

Xt(X) = e u \ 

Note that, for t > 0, the operator M Xt of multiplication by \t is an isom- 
etry from H2(C + ) into itself, and that, by the Bochner-Chandrasekharan 
theorem and the properties of the Fourier transform, a bounded linear 
operator from H2(C + ) into itself commutes with the operators M Xt if 
and only if it is a multiplication operator, or, in systems terminology, 
if and only if it is time- invariant. 

Theorem 8.1. Let T be a linear contractive operator from H2(C + ) (g> 
7i{Kk) into itself and such that 

, . T(xtf)=Xtf 
[ ' ] T( Zj f) = :///. 

Then, T is a multiplication operator by a function Jf?(\, z) which is 
such that the kernel 

(8.2) (1-JT(A, «>)') K n ,W \ 

is positive in C + x K k . 

Proof: The proof follows the lines of the proof of Theorem 15. II We use 
the Hilbert space version of the Bochner-Chandrasekharan theorem to 
assert the existence of a L(7^(-Kfc))- v alued function S such that 

T(A) = S(X)f(X), fen 2 (C + )®H(K k ), 

for which ^(A)!^^^)) < 1, VA G C+. This last norm condition on 
S is equivalent to the positivity of the kernel 

I n(Kk) - S(X)S(u)* 
-i(X - u*) 



LINEAR STOCHASTIC SYSTEMS: A WHITE NOISE APPROACH 31 

in the open upper half-plane C+. Let A G C+. Since the operator 

S(X) : H(K k ) — > H(K k ) 

commutes with the operators of multiplication by the variables Zj we 
have that, for every a G £, 

(8.3) ((S(X))(M z .))(z) = z a ((S(X)(l)))(z). 

We set: 

S>(\,z) = S(\)(l). 
Let / G H{K k ). It follows from (JS3J that 

(S(A)(/))(A,z) = ^(A,*)-/(A,z). 

The operator T is thus a contractive multiplication operator in the re- 
producing kernel Hilbert space H 2 (C + ) ® H(K k ), and the kernel (18. 2p 
is positive in C + x K k . □ 

As in the disk case, one can write a realization for 5? in terms of an 
associated reproducing kernel Hilbert space. This will not be pursued 
here. 

When the system is not random, setting z = w and ( = v in (18.21) . we 
get that the function S^{Q is contractive in C + . 



9. L2-LQO STABILITY 

In this section we prove the analog of Theorem 14.11 in the continuous 
time case. 

Definition 9.1. Let k > Z + l. The continuous time system (17. 2ft (with 
a continuous h) is said to be L2-Loo stable if there exists an M < oo 
such that 

(9.4) sup || / h(s)0u(t - s)ds\\ k < M ( f \\u(t)\\ 2 dt] 

for all Tik-valued functions u which are moreover continuous in norm 
and for which the right handside of (19 ,4p is finite. 

Theorem 9.2. The system (17. 2p is L2-Loo stable if and only if 

(9.5) sup / \\T* (t) g\\ 2 k dt < oo. 



hit) 

9&H k • 



32 D. ALPAY AND D. LEVANONY 

Proof: We first assume that ( 19. 5ft is in force. Let g G Tik of norm less 
or equal to 1. Using the Cauchy-Schwarz inequality, we obtain 



(h(s)Ou(t- s),g) Hk ds\ = | j_(u(t - s),T^ s) g)n k ds 

< 



T h( s )9\\k\\u(t - s)\\ k ds 

1/2 / r \ 1/2 



/ \\ T h(s)9\\t ds ) 
Jr J 



and thus the system is L^-Lqo stable since 



1/2 / r \ 1/2 

u(s)\\ 2 k ds 



h(s)0u(t - s)ds\\ k = sup (h(s)<)u(t - s),g) Hk 

Nlfc<i 

Conversely, assume that the system (17.21) is L 2 -Loo stable. Then for 

every g as above, 



(h(s)Ou(t-s),g) Hk ds\ = \ / {u(t - s),T^ s) g) Hk ds\ 
(9-6) N 1/2 



and so for every t, and in particular for t = 0, the functional 

« H / (u(t- s),T£ (s) g) Hk ds 
Jr 

is bounded. It follows from Riesz representation theorem for bounded 
functionals on Hilbert space that 

\ T h( s )9\\k ds < °°- 

This inequality is moreover uniform in g over all functions g such that 
II <? IU < 1, since g does not appear on the right handside of the last 
inequality in (19. 6p . □ 

We note that condition (19.51) will hold as soon as 

|7h( s )|| 2 (is < oo. 



In the nonrandom case, this means that h is in L2QR), and we obtain 
the continuous time analog of Theorem 11.31 See [24, Table 2.2 p. 19 
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and pp. 21-25]. 

In connection with the preceding result, we recall the following inequal- 
ities: First, if p and q are positive real numbers such that 1/p+l/q = 1, 
and / G L P (R) and g G L g (R), we have that the convolution / * g G 
Loo(M) and 

||/* Slice < ||/||p-N| S , 

where || • || p denotes the norm in L P (R); see [18~| Theoreme 2.3, p. 
148], and [5TJ Corollary 1 p. 280] for a more general statement. The 
situation at hand here corresponds to p = q = 2. We also recall (see 
PH Theoreme IV.15, p. 66], [SB Exercice 4, p. 141]): If / G Lq(R) 
and g G L P (R), with p G [1, oo] (oo included), then the convolution 
/ * g G L P (R), and 

Il/*S|| P <||/I|i-Nlp. 
These results should lead to other stability results in the random case. 
Such a line of research will not be developed here. 
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